## # A tibble: 1 × 1
##   avg_agreement
##           <dbl>
## 1         0.825
code n_units n_coders percent_agreement krippendorff_alpha cohen_kappa fleiss_kappa scott_pi status total_coded_as_1 total_coded_as_0 total_coding_instances usage_frequency krippendorff_interpretation kappa_interpretation
AI Image/Video (AI or not)_bin 40 4 0.875 0.7555811 NA 0.7550708 NA Calculated 134 26 160 0.8375 Good Good

Problematic Codes

Codes Needing Immediate Attention (Lowest Reliability)

Focus on these codes during training - they show the most disagreement between coders:

1. AI Image/Video_Partly AI_bin High
Agreement: 40.0% | Krippendorff α: 0.359 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
2. AI Image/Video_Completely AI_bin High
Agreement: 40.0% | Krippendorff α: 0.375 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
3. Type of Attack__Attack on political issues/achievements/ideologies_bin High
Agreement: 47.5% | Krippendorff α: 0.402 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✗ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
4. Theme of the Image/Video__Political positioning_bin High
Agreement: 47.5% | Krippendorff α: 0.409 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
5. Type of Acclaim__Acclaim/Praise/Recognition of political issues/achievements/ideologies_bin High
Agreement: 52.5% | Krippendorff α: 0.291 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
6. Theme of the Image/Video__Negative imagery/Negative campaigning: The image/video portrays the political opponent in a negative light. This can happen through sharp criticism or with humor._bin Mid
Agreement: 52.5% | Krippendorff α: 0.451 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 7 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 38 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
7. Topics__political_parties_and_politicians_candidate_presentation_politicians_as_the_main_subject_bin Mid
Agreement: 52.5% | Krippendorff α: 0.473 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 34 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
8. Type of Attack__Attack on a person/party/organization/institution_bin Mid
Agreement: 55.0% | Krippendorff α: 0.534 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
9. Type of Acclaim__Acclaim/Praise/Recognition of a person/party/organization/institution_bin Mid
Agreement: 57.5% | Krippendorff α: 0.525 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
10. Target of Attack__(Members of) minorities_bin Mid
Agreement: 57.5% | Krippendorff α: 0.423 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
11. Actors__(Members of) minorities_bin Mid
Agreement: 57.5% | Krippendorff α: 0.485 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
12. Theme of the Image/Video__Events/Landscape & city scenes: Unlike a symbolic image, people/politicians are doing something, moving, or working (e.g., groups such as politicians, refugees, farmers, protesters, police officers, etc.). Alternatively, a city or (natural) landscape is shown where something is happening (e.g., forest dieback, fire, or flooding, nuclear power plants or wind turbines)._bin High
Agreement: 60.0% | Krippendorff α: 0.164 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
13. Theme of the Image/Video__Symbolic image of person(s)/politician(s)/citizen(s) looking directly into the camera (classic campaign poster image)._bin Mid
Agreement: 60.0% | Krippendorff α: 0.485 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
14. Actors__Ordinary people / average citizens / ordinary supporters_bin Mid
Agreement: 60.0% | Krippendorff α: 0.551 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 8 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
15. People in the Image/Video__Ordinary_people___average_citizens___ordinary_supporterse_g_individuals_as_well_as_groups_of_citizens_such_as_teachers__pensioners__students__caregivers__etc___bin Mid
Agreement: 62.5% | Krippendorff α: 0.595 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
16. Target of Acclaim__PVV_bin Low
Agreement: 65.0% | Krippendorff α: 0.621 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
17. Theme of the Image/Video__Positive imagery/Acclaims: The image/video portrays past and future achievements of the party/government in a positive light. This includes drawing a positive balance, saying “thank you” to campaign helpers, or positively discussing political plans/goals._bin High
Agreement: 65.0% | Krippendorff α: 0.088 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 5 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 19 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
18. AI Labeling in Post/Ad_bin Mid
Agreement: 65.0% | Krippendorff α: 0.487 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 9 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
19. Target of Acclaim__PVV: Geert Wilders_bin Mid
Agreement: 65.0% | Krippendorff α: 0.487 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 9 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
20. Theme of the Image/Video__Event announcement/Election call/Candidate presentation_bin High
Agreement: 67.5% | Krippendorff α: 0.363 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
21. Number of People in the Image/Video_bin Mid
Agreement: 67.5% | Krippendorff α: 0.570 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
22. Topics__civil_rights_including_gender_politics_lgbtq_policies_bin High
Agreement: 70.0% | Krippendorff α: 0.146 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
23. People in the Image/Video___Members_of__minoritiese_g_refugeesLGBTQ_people_with_disabilities__Jewish_people__women__when_women_are_explicitly_labeled__depicted__or_referred_to_as_a_minority__bin Mid
Agreement: 70.0% | Krippendorff α: 0.553 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
24. Target of Acclaim__Ordinary people / average citizens / ordinary supporters_bin High
Agreement: 75.0% | Krippendorff α: 0.081 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
25. Topics__election_in_general_electoral_system_campaign_events_campaign_dates_campaign_appearances_election_polls_bin High
Agreement: 80.0% | Krippendorff α: 0.188 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
26. Topics__other_political_topic_bin High
Agreement: 82.5% | Krippendorff α: -0.044 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 11 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 22 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
27. Actors__Dutch government, ministries, parliament, and courts (ALSO KABINET SCHOOF)_bin High
Agreement: 82.5% | Krippendorff α: 0.037 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
28. Topics__environmental_and_energy_policy_bin Mid
Agreement: 85.0% | Krippendorff α: 0.542 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 18 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✓
29. Target of Attack__Dutch government, ministries, parliament, and courts (ALSO KABINET SCHOOF)_bin High
Agreement: 87.5% | Krippendorff α: -0.030 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
30. Theme of the Image/Video__Other imagery_bin High
Agreement: 87.5% | Krippendorff α: 0.078 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 14 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗

Acceptable and Good Codes (≥ 0.667 Krippendorff’s Alpha)

These codes show good to excellent reliability between coders:

People in the Image/Video__PVV__Geert_Wilders_bin

Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 15.0% (24/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓

Actors__CDA_bin

Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 10.0% (16/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Actors__CDA: Henri Bontenbal_bin

Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 7.5% (12/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Target of Attack__CDA_bin

Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 10.0% (16/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Target of Attack__CDA: Henri Bontenbal_bin

Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 7.5% (12/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Actors__GL-PvdA_bin

Agreement: 97.5% | Krippendorff α: 0.970 | Interpretation: Excellent | Units: 40 | Usage: 29.4% (47/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Actors__GL-PvdA: Frans Timmermans_bin

Agreement: 97.5% | Krippendorff α: 0.968 | Interpretation: Excellent | Units: 40 | Usage: 26.9% (43/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Target of Attack__GL-PvdA_bin

Agreement: 92.5% | Krippendorff α: 0.896 | Interpretation: Excellent | Units: 40 | Usage: 27.5% (44/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Target of Attack__GL-PvdA: Frans Timmermans_bin

Agreement: 92.5% | Krippendorff α: 0.889 | Interpretation: Excellent | Units: 40 | Usage: 25.0% (40/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

AI Image/Video_Not AI_bin

Agreement: 95.0% | Krippendorff α: 0.882 | Interpretation: Excellent | Units: 40 | Usage: 14.4% (23/160)


Example disagreements:
- Content 11 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Actors__PVV: Geert Wilders_bin

Agreement: 87.5% | Krippendorff α: 0.867 | Interpretation: Excellent | Units: 40 | Usage: 48.8% (78/160)


Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓

Actors__PVV_bin

Agreement: 87.5% | Krippendorff α: 0.860 | Interpretation: Excellent | Units: 40 | Usage: 61.3% (98/160)


Example disagreements:
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 36 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓

People in the Image/Video__GL_PvdA__Frans_Timmermans_bin

Agreement: 87.5% | Krippendorff α: 0.800 | Interpretation: Excellent | Units: 40 | Usage: 19.4% (31/160)


Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 37 (1 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✓ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

People in the Image/Video__CDA__Henri_Bontenbal_bin

Agreement: 95.0% | Krippendorff α: 0.787 | Interpretation: Good | Units: 40 | Usage: 6.2% (10/160)


Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Topics__call_to_vote_get_out_the_vote_call_without_and_with_naming_of_party_s_bin

Agreement: 80.0% | Krippendorff α: 0.765 | Interpretation: Good | Units: 40 | Usage: 39.4% (63/160)


Example disagreements:
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 14 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓

AI Image/Video (AI or not)_bin

Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)


Example disagreements:
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓

Negative Tendency/Tonality_bin

Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓

Positive Tendency/Tonality_bin

Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)


Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓

Theme of the Image/Video__Humor / Satire (depictions used to mock, exaggerate, or parody)_bin

Agreement: 80.0% | Krippendorff α: 0.743 | Interpretation: Good | Units: 40 | Usage: 30.0% (48/160)


Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗

Actors__VVD_bin

Agreement: 92.5% | Krippendorff α: 0.694 | Interpretation: Good | Units: 40 | Usage: 8.1% (13/160)


Example disagreements:
- Content 24 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 28 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Topics__domestic_and_migration_policy_public_safety_crime_incl_femicide_political_radicalism_religious_fanaticism_terrorism_bin

Agreement: 72.5% | Krippendorff α: 0.692 | Interpretation: Good | Units: 40 | Usage: 51.9% (83/160)


Example disagreements:
- Content 10 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓

Theme of the Image/Video__Nostalgic / historical Dutch imagery (references to glorified past or national symbols)_bin

Agreement: 90.0% | Krippendorff α: 0.688 | Interpretation: Good | Units: 40 | Usage: 8.8% (14/160)


Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 14 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗

Most Problematic Content Pieces (Highest Overall Disagreement)

These content pieces have the most disagreements across all codes:

Content Review

Content Review

Content 1

URL: https://www.facebook.com/GeenAangifte/posts/pfbid02dhGBr1rge85HdDHjSVHRzaSKvCmVdk32NVniSkYo8HwVPuYrCGFogDbgng6P5v33l

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 2

URL: https://www.facebook.com/GeenAangifte/posts/pfbid02gVf85P9Z8FcdJuQTsScp2wfwqHmfguJzuPcwLpivn2g9NSNiPvDSFy1t6CNrGQnEl

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 3

URL: https://www.facebook.com/GeenAangifte/posts/pfbid02q3ugyYJZUacM7Ccj17xUZ2mDGYxByPtdemapdpoTrFS4Fhpz51gbnwJ2K7Sad6P1l

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 4

URL: https://www.facebook.com/GeenAangifte/posts/pfbid033pTnLbXCuqWoJpr4TiyMMVvGDJRuE5RR9aLby729TdxFxs16L9BTh7CbF6dNmVi6l

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 5

URL: https://www.facebook.com/GeenAangifte/posts/pfbid09zTN7PLkyBxAegTeYcPok1X6ShuQEJy4m9qeG9eE3r5fZoD7t4tbdaiigEESBrXHl

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 6

URL: https://www.facebook.com/GeenAangifte/posts/pfbid0Jt35mR5se943GP1k1NcGpJGF74ufgT9ucF6bbX2ioFVUdpTdd3sNZfbXwqHrgmtZl

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 7

URL: https://www.facebook.com/GeenAangifte/posts/pfbid0JyAmKhvBSBpXmEtLQ7iSbTpMK9d9rBhqxzL6u8i5R3M1fBWGJf76DDQnPzy9s5pel

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 8

URL: https://www.facebook.com/GeenAangifte/posts/pfbid0kZE2Fm1b3oSEYvaF4SoB17PsSahEW9eNLge9VS1nLCW4sGPeTdneLz9JyJwc1rHql

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Content 9

URL: https://www.facebook.com/GeenAangifte/posts/pfbid0Lh6Yb9VxttQqsmR94MMPBbEXha2RuChAkz2RuokM9A56jdxgLUHG5hHaoG3Q1Shfl

Post Screenshot
Screenshot of post

View Original Post

Coders: Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Do:✓ El:✓ Ly:✓

Content 10

URL: https://www.facebook.com/GeenAangifte/posts/pfbid0nktgkgJ8K8bUsPLpDutBaYY9Sm6yPmok5zSaxoxRUy24LhaHh3ENA6nbckgFRhFbl

Post Screenshot
Screenshot of post

View Original Post

Coders: Daisy, Doortje, Ella, Lynn

Key Variables:

  • AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
  • Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
  • Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓

Data Tables

Complete Reliability Statistics

Most Problematic Codes


Content Index

Code Search Tool

Use this table to search for any code and see all content that was coded with that code.

Search by Code

Coding Coverage by Coder:

  • Doortje: 40 unique URLs coded
  • Lynn: 40 unique URLs coded
  • Ella: 39 unique URLs coded
  • Daisy: 38 unique URLs coded

Type any code name in the search box below to find all content that was coded with that code.

Note: This table only shows content that was coded by at least 2 coders to ensure meaningful comparisons.


Dashboard generated on 2025-09-23 18:30:10.574687

Summary

Key Implementation Updates:

Category Alignment Fixed: All binary conversion logic now uses exact category text from categories.txt

Conditional Coding Logic Implemented: - If coder determined image/video is “NOT AI-generated”, then ALL subsequent variables (AI Labeling, Number of People, Tonality, etc.) are correctly treated as NA (not coded) - This ensures reliability calculations only include coders who had the opportunity to code each variable

AI Binary Variables Working: - “Partly AI-generated” correctly counts as 1 in “AI or not” binary variable - All AI categories (Completely, Partly, Not AI, Unsure) properly converted to binary format

Impact: - 23 responses were coded as “NOT AI-generated” - These coders are now correctly excluded from reliability calculations for subsequent variables - More accurate Krippendorff’s Alpha calculations for AI-related and content variables